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Abstract. Recent work in compressed sensing theory shows that 
nx N independent and identically distributed (IID) sensing matri- 
ces whose entries are drawn independently from certain probability 
distributions guarantee exact recovery of a sparse signal with high 
probability even if n <C N. Motivated by signal processing ap- 
plications, random filtering with Toeplitz sensing matrices whose 
elements are drawn from the same distributions were considered 
and shown to also be sufficient to recover a sparse signal from 
reduced samples exactly with high probability. This paper con- 
siders Toeplitz block matrices as sensing matrices. They naturally 
arise in multichannel and multidimensional filtering applications 
and include Toeplitz matrices as special cases. It is shown that the 
probability of exact reconstruction is also high. Their performance 
is validated using simulations. 



1. Introduction 

The central problem in compressed sensing (CS) is the recovery of a 
vector x e M. N from its linear measurements y of the form 

(1.1) yi =<x,ifi>, 1 < % < n, 

where n is assumed to be much smaller than N. Of course, for n <C N, 



(1.1) posts an under-determined system of equations which has non- 
unique solutions. Exact recovery of the original vector x needs further 
prior information. The work by Candes, Donoho, Romberg, Tao, and 
others (see e.g. pQ, [2J, and the references therein) showed that under 
the assumption that x is sparse, one can actually recover x from a 
sample y which is much smaller in size than x by solving a convex 
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program with a suitably chosen sampling basis tpi, 1 < i < n. If we 



write the linear system (1.1) in the form 



(1.2) y = $a;, where $ is an n x iV matrix, 

then the question about what sampling methods guarantee the exact 
recovery of x becomes the question about what matrices are "good" 
compressed sensing matrices, meaning that they ensure exact recovery 
of a sparse x from y with high probability under the condition that 

In [3] Candes and Tao introduce the restricted isometry property as a 
condition on matrices $ which provides a guarantee on the performance 
of $ in compressed sensing. 

Following their definition, we say that a matrix $ G ]R nxAr satisfies 
RIP of order m G N and constant 5 m G (0, 1) if 

(1.3) (1 - 5 m )\\z\\l < \\a> T z\\l < (1 + 5 m )\\z\\l \/z G w |T| 



where Tc {1,2,..., N}, \T\ < m, and $t denotes the matrix obtained 
by retaining only the columns of $ corresponding to the entries of T. 

It was shown in [3] (reinterpreted in jl]) that if $ satisfies RIP of 
order 3m and constant <5 3m G (0, 1): 

(1.4) (1 - 5 3m )\\z\\l < \\Q T z\\l < (1 + <W>INl2 Vz G R m , 
where Tc {1, 2, ... , A^} and |T| < 3m, the decoder given by 

(1.5) ^(y) '■= argmin||x|| ; jv subject to $x = y 

ensures exact recovery of x from y. 

Recently Baraniuk et al j5] showed that matrices whose entries are 
drawn independently from certain probability distribution P satisfy 
RIP of order m with probability > 1 — e~ C2n for every 5 m G (0, 1) 
provided that n > c\m\n(N / m) , where C\,C2 > are some positive 
constants depending only on S m . Motivated by applications in signal 
processing, Bajwa et al [6] considered (truncated) Toeplitz-structured 
matrices whose entries are drawn from the same probability distribu- 
tions P and showed that they satisfy RIP of order 3m with probability 
> 1 — e _C2n / m for every 5 3m G (0, 1) provided that n > cim 3 \n(N/m). 

Some examples of probability distributions that can be used in this 
context have been studied in [7]. They include 
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;i.6) 



i,3 



n 



with probability 1/2 
with probability 1/2 



with probability 1/6 



with probability 2/3 
with probability 1/6 



Motivated by applications in multichannel sampling, in this paper we 
will consider Toeplitz block matrices with elements in each block drawn 
independently from one of the probability distributions in ( |1.6 ) and 
some other block matrices with similar structures. We show that such 
matrices also satisfy RIP of order 3m for every 8 3m G (0, 1) with high 
probability, provided that n > cilmln(N/m), where I < 3m(3m — 1) 
and C\ > is some positive constant depending only on 5 3m . These 
Toeplitz block matrices naturally represent the system equation matri- 
ces in multichannel sampling applications where a single input signal is 
recovered from output samples of multiple channels with IID random 
filters. The result justifies the use of multichannel over single-channel 
systems in compressed sensing. The advantages of Toeplitz matrices 
pointed out in [6], like e.g. efficient implementations, also apply to the 
matrices considered in this paper. 



2. Main Result 
Theorem 2.1. For Toeplitz block matrices of the form 



( 



(2.1) 



$ 2 
$ 3 



$1 \ 

$ 2 



$1 J 



nnxN 



with blocks $j G IR dxe whose elements are drawn independently from 
one of the probability distributions in (1.6), there exist constants ci, c 2 > 
depending only on 5 3m G (0, 1), such that: 

(i) If I — 3m(3m — 1), then for any n > c\lm \n(N/m), $ satisfies 
RIP of order 3m for every 6 3m G (0, 1) with probability at least 
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(ii) If I > 3m(3m — 1), then for any n > c\vn? \n(N/m), $ satisfies 
RIP of order 3m for every <5 3m G (0, 1) with probability at least 

I _ e -C2n/m 2 

The above theorem gives the requirement for and probability of ex- 
act reconstruction of a 3m-sparse signal x from a measurement y if 
Toeplitz block matrices are used. In particular it says, that if the num- 
ber of blocks (I) in one column of $ does not exceed a certain value 
depending only on the sparsity of the signal x, the probability of perfect 
reconstruction is greater and the number of required measurements is 
smaller than if I is not bounded in this way. 

As noted in [Ul E] , Toeplitz matrices naturally arise in one-dimensional 
single-channel filtering applications where the matrix elements are fil- 



ter coefficients. Similarly, the Toeplitz block matrices defined in (2.1) 
naturally arise in one-dimensional multichannel sampling applications 
where the length of the filter is at least I points larger than that of the 
input signal. The conventional multichannel sampling theorem states 
that the sampling rate reduction over the single channel system cannot 



exceed the number of channels for exact recovery. While Theorem 2.1 
suggests that multichannel systems with IID random filters might be 
able to reduce the sampling rate by a factor higher than the number 
of channels. 

We remark, that for other block matrices with similar structures, the 



result in Theorem 2.1 also holds (see IV) 



3. Proof of Main Result 

Let T C {1, 2, ... , iV}. Denote by $t,i the i-th row of the matrix 
$t obtained by retaining only those columns of $ corresponding to 
the elements in T, and let $t,j H denote the set of random variables 
common to the z-th row of &t and the j-th block of $. 



We note that, if ( |L4| ) holds for a set T C {1,2,..., N}, then it also 
holds for any T C T. To prove that Toeplitz IID block matrices satisfy 
RIP with high probability, it is therefore enough to consider only those 
sets T where |T| = 3m. 

Lemma 3.1. Define the sets Dt,% by 

Dr,i = {j ^ {!) 2, . . . ,n} : is stochastically dependent on $t,i, j 7^ i}- 



(i) IfT satisfies |T| < 1+v 2 1+4 ' ; then \D T>i \ < \T\(\T\ - 1) < I - 1. 

(ii) IfT satisfies |T| > 1+v ^ 1 , then \D T)i \ < I - 1. 
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Proof. Fix $t,i- T defines a sequence {r ts }^ =1 , where r ta is the number 
of columns from block $ ts in T. Thus X)s=i r *s = 1-^1 ■ Consider the 
number of rows that have dependency with the elements in & ta fl $t,i- 
Since all elements inside a single block are independent, there can be 
no dependencies within one block. Moreover, because of the structure 
of the matrix $, there can be at most 

if $ 4a n $ T , 4 = 
\T\-r ts if $ 4a H $ T , 4 ^ 

rows outside the block $ ts that depend on any element in $t s fl $t,«- 
(i) If T satisfies \T\ < i.e. if I > \T\(\T\ - 1), these rows may 

be distinct, and we have 



\Dt,\ < E d T l 

{t 8) 36{l,2,...,A:}:*t 8 n* r>i ^0} 



<53(|T|-1) = |T|(|T|-1)</-1 

dependent rows. 

(ii) If T satisfies \T\ > 1+v ^+ iI , i.e. if \T\(\T\ - 1) > I, then \D Tti \ is 
upper bounded by the number of blocks, so \D Ti \ < I — 1. 

□ 

In [7] it has been shown that for given n, N, and T C {1, 2, ... , A^} 
with |T| < m, an IID matrix of size n x N with entries dr awn inde- 
pendently from one of the distributions P in (1.6^ satisfies (1.3) with 
probability 

(3.1) > 1 - e - f ^ mM , 
where 

(3.2) f(n,m,5 m ) = c n - raln(12/5 m ) - ln(2). 

Now consider a (truncated) Toeplitz block matrix $ e ]R raxAr as 
in (2.1), where the blocks {^i}^ -1 are such IID matrices e R dxe 



with entries drawn independently from the same set of distributions as 
above. 

The following lemma gives an upper bound for the probability that 



a matrix as in (2.1) with 1 < I < n satisfies (1.4) for any fixed subset 



T with \T\ = 3m. Lemma 3.3 gives a tighter bound for the case 
1>\T\(\T\-1). 



1 These matrices consist of columns whose squared norm is equal to 1 in 
expectation. 
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The proof of Lemma 3J2 uses an argument similar to the one in the 
proof of Lemma 1 in [6] . 

Lemma 3.2. For given T C {1,2, . . . , N} with \T\ = m, and 5 m G 

(0, 1), the Toeplitz block submatrix $y satisfies (1-4) with probability at 
least 

1 _ „- f(d,m,6 m )+\n(l) 



Proof. We can write the matrix <3>t as 
(3.3) $ T = 



T 



where the blocks of size dx \T\ are given by the columns determined 
by T in the i-th row of blocks &k+i-2, • • • , $i) in 

Note that Vz G {1,2,.. . , I} , <3>^ is an IID matrix with entries from 
one of the distributions in (1.6). If we let = Vl$ % T , then the matrices 
& T have columns whose squared norm is equal to 1 in expectation and 
by d3~I| satisfy (fTi}, i.e. 

41 < W*t41 <(l + S m )\\z\g 
Vz G R m , Vz G {1,2,...,/}, 



'1 - 6 n 



with probability at least 
(3.4) 

Now since 



-f(d,m,6 m ) 



(3.5) 



En*; 



Ejii*s*iii 



i=l 



and X/»=i I = 1> we have 



:i-<j« 



12) 



Vs G M |T| . 



In other words, the event E\ = {$^ satisfies (1.4) Vi} implies the event 
E 2 = {$t satisfies (1.4)}. Consequently, 

P(P 2 ) = 1 - P(E C 2 ) > 1 - P(P X C ) 
i 



> 1 - ^P({$^. does not satisfy (1.4)}) 

i=i 
i 

> 1 - e- f{d ' m ' 5m) (by Q) 

i=i 

_ J _ „— /((i,m,(5 m )+ln(/) 
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Lemma 3.3. For given T C {1,2, . . . , N} with \T\ = m, and S m G 



(0,1), if I > |T|(|T| — 1), the Toeplitz block submatrix $t satisfies (1-4) 
with probability at least 

1 _ e -f(ln/qi,m,6 m )+la(g) 



where q = \T\(\T\ — 1) + 1. 

Proof. Let &t,i denote the i-th row of $r and construct an undirected 
dependency graph G = (V, E) such that V = {1,2, . . . ,n} and 

E = {(i, i') G V x V : % ^ i', <3>t,; and $ Tii / are dependent}. 



By Lemma 3.1, $t,« can at most be dependent with |T|(|T| — 1) other 



rows. Therefore, the maximum degree A of G is given by A < \T\ (|T| — 
1), and using the Hajnal-Szemeredi theorem on equitable coloring of 
graphs, we can partition G using q = \T\(\T\ — 1) + 1 colors. Let 
{CjYj=i be the different color classes, then 

\ c i\ = LV?J or \ C j\ = \ n /q~}- 

Now, let $^ be the \Cj \ x |T| submatrix obtained from $y retaining the 
rows corresponding to the indices in Cj and define $^ = ^n/\Cj\& T . 
Then 



(3.6) Vz6R |r| , \\$ T z\ 



n 



Every & T is a \Cj\ x |T| IID matrix whose columns have squared norm 
equal to 1 in expectation. By (3.1), they satisfy (1.4) with probability 
at least 



(3.7) 



I _ e ~f(\Cj\,m,8m) > ]_ _ e -f([n/qi,m,8 m ) ^ 



Since Y^j=\ = 1' by (3-6), we have that if 



(l-cWIMl' < ll^lll < {Mm)\\z\\l, \/z G M |T| , Vj G {1,2, . 
then 



-,g} 



1 - UNI* < 11*7*112 < (i + UIMI*, g ir' t '. 
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In other words, the event E\ = {& T satisfies (1.4) for all j} implies the 
event E 2 = {$t satisfies (1.4)}. Consequently, 



P(E 2 ) = 1 - P{E C 2 ) > 1 - P(E1] 



> 1 - ^P({$^ does not satisfy (1.4)}) 

3=1 | 

<? 

> 1 - e- f(lnM ' m ' 5m) (by @3) 

— I _ e -f([n/qi,m,8 m )+\n(q) 



Main result in Theorem 12.11 



□ 



Proof, (i) From (3.2) and Lemma 3.2 we have that $ satisfies (1.4) for 
any T C {1,2,..., N} such that |T| = 3m with probability at least 



(3.8) 



1 _ e -cad+3mln(12/5 3m )+ln(2)+ln(0 



Since there are 

{Zt) < (eN/3m) 3m such subsets, usine; Bonferroni's 

inequality (see e.g. [8]) yields that $ satisfies RIP of order 3m with 
probability at least 



(3.9) 



1-e 



-con/Z+3m[ln(12/5 3m )+ln(A73m)+l]+ln(2)+ln(Z) 



Fix c 2 > and pick c\ = (3 ln((12/5 3m )) + 15)/(c — c 2 ). Then for 
any n > C\lm ln(A^/m), the exponent of e in (3.9) is upper bounded by 
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-C 2 n/l: 



c n 



+ 3m 



In 



12 N 



3m 



In 



3/m 

Co - c 2 



12 N 
hm 3m 
, 12 A' 

In 



S 3m 3m 
+ 1 



+ 1 



+ ln(2Z) < 



c 2 n 



n 



S 3m 3m 



+ ln(2Z) < y(c -c 2 ) 



+ 1 + ^ + ln ^ 



3m 



3m 



< n 



3lm\n(^) 
Co - c 2 

3/m In (Z) 

c o — c 2 



ln te^) +1+ln(2)+ln(/) 



3mln(^) 



< n 



In 



12 



CiZm In I — < n 

my 



3 m 



< n 



(ii) From (3.2) and Lemma 3.3 we have that $ satisfies (1.4) for any 
T C {1, 2, ... , iV} such that \T\ — 3m with probability at least 



(3.10) 



1 

>1 



-co |n/<?J +3m ln(12/<5 3m )+ln(2)+ln(?) 
-con/9m 2 +3mln(12/<5 3m )+ln(2)+ln(9m 2 )+co 



Since there are ( 3 ^J < (eiV/3m) 3m such subsets, using Bonferroni's 
inequality again yields that $ satisfies RIP of order 3m with probability 
at least 



(3.11) 



1 _ e -cofe/9m 2 +3m[ln(12/<5 3m )+ln(iV/3m)+l]+ln(2)-fln(9m 2 )+co 



Now fix c 2 > and pick c\ > 27c 3 /(c — 9c 2 ), where c 3 = ln(12/5 3m ) + 
ln(2) + Co + 4. Then, for any n > C\m? ln(N/m), the exponent of e in 
(3.11) is upper bounded by — c 2 n/m 2 . This completes the proof of the 
theorem. □ 



Remark 3.1. If I — 1, then $ is an IID matrix, and Theorem 2.1 lower 
bounds the probability of $ satisfying RIP of order 3m by 1 — e~ C2 ' n , 
which recovers the bound obtained in jS]. 



Remark 3.2. As long as / < 3m(3m — 1), a matrix $ as in (2.1) satisfies 
RIP of order 3m with probability 1 — e~ C2n/// > 1 — e c W m , which is 
the bound given in [BJ, since 

(3.12) — Cinjl < — c 2 n/(9m 2 — 3m) < — c 2 n/9m 2 = — c' 2 n/m 2 . 
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4. Other Block Matrices 



4.1. Circular matrices. The above consideration can be applied to 
(truncated) circulant block matrices of the form 



(4.1) 



$ 2 
$ 3 



V $J-1 $1-2 

where the blocks <3>, are all IID matrices. 



$ 2 



$1 / 



nnxN 



Similar to (2.1 ), the circulant matrices in (4.1 ) also represent the sys- 



tem equation matrices in multichannel sampling, but the convolution 
is a circular one. They usually arise in applications where convolutions 
are implemented by multiplications in Fourier domain. 

Before we present the theorem for this type of matrices, we first 
comment on the maximum number of stochastically dependent rows in 
a (truncated) circulant matrix of the form 



(4.2) 



.4 



lq-1 



a i 



a 2 

«3 



Oi \ 

a 2 



\ a p -i a p -2 a p J 

Again, we denote by Atj the i-th row of the matrix At, which is 
obtained by retaining only those columns of A corresponding to T C 
{1-2 V}. 

Lemma 4.1. Define the sets Dt,% by Dt,i = {j G {1,2, ... ,p} : 
Atj is stochastically dependent on AT,i,j ^ i}- Then Dtj has car- 
dinality at most \T\(\T\ — 1). 

Proof. Note first, that an upper bound for the case p = q clearly upper 
bounds the case where p < q. We may therefore assume that p = q and 
A is a square circulant matrix. Then the number of rows stochastically 
dependent on At,% is independent of i and we can, w.l.o.g., assume that 
i = l. Let t G {0, l} q be a g-tuple defined by 

if j & T 

1 if jET 

and consider the matrix 

/ t \ 



j=l, 



,q, 



(4.3) 



.4 
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where a : {0, l} q — > {0, l} q defines the right-shift (ti, . . . , t 9 _i,t 9 ) — > 
(t q , ti, . . . , t g _i). Denote by A T the matrix obtained by retaining only 
those columns of A corresponding to T C {1, 2, . . . , q}. It is now easy 
to see that 

\D T)i \ = \{A T)i ,ie{2,...,q} : h(A T>1 , A T>i ) < \T\}\ 
< {# of ones in t} • ({# of ones in t} — 1) 
= |T|(|T|-1), 

where h : {0, l} q x {0, l} q — > N is the Hamming distance defined by 
h(x,y) = \{j G {l,2,...,g} : Xj ^ yj}\. 

□ 

The following theorem gives lower bounds for the probability that 
a circulant block matrix as in 14.21 satisfies the RIP of order 3m. Note 



that the bounds obtained are the same as in 2.1 although the number 
of independent entries in $ is greater than before. This is due to the 
nature of the proof using the number of stochastically dependent rows 
of $ which is the same for both Toeplitz and circulant matrices. 



Theorem 4.1. Let $ be as in (4-1 )■ Then there exist constants ci, C2 > 



depending only on 5 3m G (0, 1), such that: 

(i) If I < 3m(3m — 1), then for any n > Cilm\n(N/m) , $ satisfies 
RIP of order 3m for every 8^ m G (0, 1) with probability at least 

1 — e~ C2n// '. 

(ii) If I > 3m(3m — 1), then for any n > cim 3 ln(N/m) ! $ satisfies 
RIP of order 3m for every 8^ m G (0, 1) with probability at least 



1-e 



-C2n/m 2 



Proof. A similar argument as the one in the proof of Lemma 3.1 shows 
that the upper bound for the maximum number of rows stochastically 
dependent on any row of a (truncated) circulant block matrix is the 



same as for the (truncated) Toeplitz block matrices (use Lemma 4.1). 
Then the proof of Theorem 2. 1| directly applies to the setting at hand. 

□ 



4.2. Circulant-circulant Matrices. We also consider matrices that 
are (truncated) circulant block matrices whose blocks are themselves 
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circulant: 



(4.4) 



(4.5) 





$k-i 


$2 


$1 \ 


$1 


$ k 


... $ 3 


$2 


I $1-1 


$1-2 




$1 ) 


( vi 




... tp\ 


A \ 






... <p\ 










f\ / 



Denote by r : {0, l} kp — > {0, l} kp the right-shift of blocks $i and by 
a : {0, l} kp — > {0, the right-shift of elements inside a block $i, 
both by one position. These matrices arise in two-dimentional imaging 
applications where the independent elements are the coefficients of the 
point spread function of the imaging system. Replacing (4.3) in the 



proof of Lemma 4.1 by 



A 



( 



t 



\ 



(J (i-l)(mod P ) r L^rJ u\ 



ilqxkp 



readily yields the upper bound |T|(|T| — 1) for the number of rows 



stochastically dependent on any one row of $. Applying Lemma 3.3 



and Theorem 4.1 shows that the probability for perfect reconstruction 
is no less than 1 — e~ C2n ' m . This says that imaging systems with IID 
random point spread functions can significantly reduce the number 
of acquired samples, while still being able to reconstruct the original 
sparse image if the above conditions hold. 



4.3. Circulant-circulant Block Matrices. As a generalization of 
the matrices defined by (4.4) and (4.5), the following matrices are also 
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considered: 



(4.6) 







$2 


$1 


\ 


$1 




• $3 


(J) 2 












/ 






• • T 2 




\ 








T 2 




^2-1 


^2-2 




T i2 


/ 



r,nxN 



where the blocks are all IID matrices. These matrices arise in mul- 
tichannel two-dimensional imaging applications where the number of 
rows in Tj corresponds to the n/ilih) independent channels. We show 
next that these matrices are also good compressed sensing matrices. 



Corollary 4.1. Let $ be as in (4-6). Then there exist constants ci, c 2 > 
depending only on 5^ m G (0, 1), such that: 

(i) If hh < 3m(3m — 1), then for any n > cxl\l^m\a.{N / m) , $ 
satisfies RIP of order 3m for every <5 3m G (0, 1) with probability 
at least 

(ii) If hh > 3m(3m — 1), then for any n > cim 3 hi(N/m), $ sat- 
isfies RIP of order 3m for every 8^ m g (0,1) with probability at 
least 

]_ _ g-c 2 n/m 2 



This follows directly from Lemma 4.1 and Theorem 4.1 



4.4. Deterministic Construction. The CS matrices we have consid- 
ered so far are based on randomized constructions. However, in certain 
applications, deterministic constructions are preferred. In [TU] DeVore 
provided a deterministic construction of CS matrices using polynomials 
over finite fields. We will consider deterministic block matrices based 
on DeVore's construction. Let us first recall the construction in [TO]. 

Consider the set Z p x Z p , where Z p denotes the field of integers 
modulo p, p a prime. This set has n := p 2 elements. Define P r := {/ G 
Z p [x] : deg(/) < r}, < r < p. This set has iV := p r+l elements. For 
every / G P r , define the graph of / by 



Q{f) = {(x,y) EZ p xZ p :y = f{x),x G Z p } C Z p x Z p 
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and consider the column vector v(f) G {0, 1}™, indexed by the elements 
of Z p x Z p ordered lexicographically, given by 

v (f) '■= (l(o,o)ee(/)> • • • > l(o,p-i)ee(/)> l(i,o)es(/), • • • , , 
where 

' 1 if (a,b)eG(f) 
if (a, 

Construct the matrix $ = ( v (fi), v (f2), ■ ■ ■ , t>(/iv)), where the poly- 
nomials fi are ordered lexicographically with respect to their coeffi- 
cients. It was shown in HD1 . that the matrix <3> = -^$n satisfies RIP 
for any m < p/r + 1 with 5 = (m — l)r/p (< 1). 

Now consider 



1 (a,b)eG(f) 



(4.7) ^ c 



/ $t-l ■■■ ^2 *1 \ 

%+l ■■■ #3 ^2 



D sp 2 X tl 



where tl < p r+1 , and each block ^ G M. p2xl is constructed from the first 
tl vectors v (/), / G P r , as above. 

Theorem 4.2. TTie matrix \1/ = ^=^0 satisfies RIP with 8 — (m 
l)r/p for any m < p/r + 1. 



Proof. As before, we only have to consider the case where |T| = m. 
Let T C {1,2, . . . ,tl} such that |T| = m, and let be the matrix 
obtained by retaining only those columns of \l/ corresponding to the el- 
ements in T. Consider the matrix Gt = ^ t ^t- Since every column of 
\l/o has exactly sp ones, the diagonal elements of Gt are all one. An off 
diagonal element of Gt has the form gfj = YH=i( v x,ij v x,j)i where i, j G 
{1,2,..., m}, and v X)i denotes the vector (^/ T ,{x-i)n+i,i, ^T,(x-i)n+n,i) 
{0,l} n that represents some polynomial / G P r . Since the graphs of 
two different polynomials in P r have at most r elements in common, 
gfj < sr/sp = r/p for any i ^ j. Therefore, the sum of all off diagonal 
elements in any row or column of Gt is < (to — l)r /p = 5 < 1 whenever 
m < p/r + 1. We can, therefore, write 

(4.8) G T = I + B T , 

where ||-Br||i < 5 and ||5t||oo < 5. Since H-Brlll < ||-Bt||i||-Bt||oo> we 
have that ||-Bt||2 < 8 and so the spectral norms of Bt and B^. 1 are 
< 1 + 5 and < (1 — respectively. This shows that \l/ satisfies 



(1.4). □ 



TOEPLITZ BLOCK MATRICES IN COMPRESSED SENSING 15 



1 



0.9 



O.B 

(!) 

| 0.7 

CO 

"6 0.6 



1 0-5 

O 

a. 0.4 

03 
O 

: 5. 0.3 
E 

LU 

0.2 



0.1 



50 100 150 200 250 300 

Number of Observation 

Figure 1. Empirical probability of success plotted 
against the number of observations for IID, Toeplitz 
block, and Toeplitz matrices. 



5. Numerical Results 

To validate that the probability of exact recovery for Toeplitz block 
CS matrices is high, the performance of Toeplitz block, IID, and Toeplitz 
CS matrices is compared empirically In our simulation, a length n = 
2048 signal with randomly placed m = 20 non-zero entries drawn in- 
dependently from the Gaussian distribution was generated. Each such 
generated signal is sampled using n x N IID, Toeplitz and Toeplitz 
block matrices with entries drawn independently from the Bernoulli 
distribution and reconstructed using the log barrier solver from 
The experiment is declared a success if the signal is exactly recovered, 
i.e., the error is within the range of machine precision. The empirical 
probability of success is determined by repeating the reconstruction 
experiment 1000 times and calculating the fraction of success. This 
empirical probability of success is plotted as a function of the number 
of measurement samples n in Fig. 1. The simulation results show, that 
in the vast majority of applications all Toeplitz block matrices perform 
similar to IID matrices. 




■ IID 

1=5 

Toeplitz 
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